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(57) Abstract 



A computer apparatus includes a com- 
puter processing unit for operating upon data 
and providing data for display and a hand- 
held input/output display unit. The display 
unit includes a housing sized to be grasped 
by a user's hand. A computer display is lo- 
cated within the housing at a position to al- 
low the user to view the display through an 
eyepiece. A three button user input interface 
is integrated with the computer display in the 
housing and is operatively connected to pro- 
vide user input to the processing unit. The 
computer processing unit may also be inte- 
grated into the housing with the display. Fur- 
ther a method of navigation using the three 
button user input interface is provided, e.g., 
using a tree based structure and/or a circular 
navigational structure. 
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HAND-HELD COMPUTER APPARATUS WITH THREE BUTTON 
5 INTERFACE AND METHODS REGARDING SAME 

Field of the Invention 

The present invention is generally related to computing devices. More 
particularly, the present invention pertains to hand-held computer devices and user 
10 interfaces for such devices. 

Backgromnfl of the Invention 
Display technologies are emerging which have importance for a variety of 
applications. For example, new display technologies are being used in hand-held 

15 personal digital assistants (PDAs), head-mounted displays (HMDs), miniature 
monoculars or binoculars, etc. Recent advances in hardware and software 
technologies enable the application of powerful computing platforms in a 
comfortable, body-worn format. Application of wearable computers allows for 
individual users to remain integrated with information systems while operating 

20 hands-free and/or without hard-wire connection of such computers to other 

components. For example, wearable computers provide only a limited advantage if 
the computing platform must continue to be connected to a fixed structure for power 
and/or network connectivity. Consequently, wearable systems rely upon wireless 
network technologies to enable these systems to be integrated into collaborative 

25 environments. 

There is an increasing need for field-portable personal information 
processing systems (PIPSs) which allow collaborative communication between a 
user and other parties or information systems that can provide the user with needed 
information and/or direction. For example, collaborative communication, diagnosis, 

30 and action among control room and field personnel in the context of large-scale 
processing plants is highly desirable. For example, such functions are required 
between control room and field personnel in the context of large refineries, 
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petrochemical plants, and pulp and paper mills. Field-portable personal information 
processing systems allow highly mobile, wireless access to a plant information 
infrastructure such as distributed control system (DCS) point data and on-line 
procedures. Personal information processing systems are used by field operations 
5 and maintenance personnel to enhance situation awareness, increase collaboration 
among and between field and control room personnel, and reduce operator-induced 
control and communication errors in the day-to-day operations of a processing plant. 

Conventionally, computer devices have been used to provide personal 
information processing system functionality. Such computer devices generally have 
10 included various display devices and user interfaces. For example, such devices 

may include notebook pad-type devices, tablet input devices, head-mounted displays 
for hands-free operation, small or wearable keyboards, or voice actuation devices. 

However, conventional devices used for personal information processing 
systems do not recognize problems associated with the human interface 
15 requirements for such systems. Personal display systems impose various problems 
associated with the input devices being used, ease of movement of the user, and 
compatibility with changing and/or harsh ambient environments where users require 
such devices. For example, the wearing of a display on a helmet may provide 
obstruction of a user's vision. Helmet-mounted displays add weight to the already 
20 heavy helmets causing stress on the user's body. Further, such head-mounted 
displays get easily bumped around as the wearer walks under obstructions in a 
processing plant environment or any other user environment. Further, wearable and 
tablet computers typically have displays plagued by a limited screen size and/or 
have various user input challenges. For example, users of such personal information 
25 systems may wear gear such as gloves or be required to carry a large quantity of 
accessories or gear. Inputting information into a personal information system when 
wearing gloves becomes a difficult process with most conventional systems. Even 
just navigating through information available in such systems when in the field with 
or without gloves may be challenging. 

30 
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Summary of the Invention 

Generally, the present invention integrates a display and navigational input 
tools for use with a computing unit to address one or more of the problems relating 
to conventional devices described above. 

A computer apparatus according to the present invention includes a 
computer processing unit for operating upon data and providing data for display and 
a handheld input/output display unit. The display unit includes a housing sized to 
be grasped by a user's hand. The housing includes an eyepiece. A computer display 
is located within the housing at a position to allow the user to view the display 
through the eyepiece. A display driver is used for displaying data from the 
processor device on the computer display. A three button user input interface is 
integrated with the computer display in the housing and is operatively connected to 
provide user input to the processing unit. The three button user interface includes an 
up button, a down button, and an enter button. The enter button is operable to 
present a menu on the computer display listing at least a plurality of menu items 
corresponding to at least a plurality of applications. Further, the three button user 
input interface is operable to navigate between the applications and within the 
applications. 

In one embodiment of the apparatus, the enter button is a multi-function 
button. For example, a menu is displayed on the computer display upon pressing 
and holding the enter button and one of the menu items of the menu is selected upon 

clicking the enter button. 

In another embodiment of the apparatus, the menu on the computer display 
lists a plurality of application menu items corresponding to a plurality of 
applications, and further lists application context sensitive menu items 
corresponding to one of the applications, if any. 

In yet another embodiment of the apparatus, the enter button is operable to 
present on the computer display an application window having a circular navigation 
interface structure corresponding to a particular application context sensitive menu 
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item. Further, the three button user input interface is operable with the circular 
navigation interface structure to navigate within the application window, e.g., 
change a state of data within the circular navigation interface structure upon clicking 
of the enter button. 

5 In yet a further embodiment of the apparatus, the enter button is operable to 

select one of the plurality of applications to present an application main screen 
having a tree-based structure on the computer display listing a plurality of 
application options corresponding to the selected application. Further, the three 
button user input interface is operable with the tree-based structure of the 

10 application main screen to navigate within the tree-based structure for the selected 
application, e.g., changing a state of data within the tree based structure upon 
clicking of the enter button, collapsing and expanding portions of the tree-based 
structure upon clicking on the enter button, etc. 

In other embodiments of the apparatus, the computer processing unit is 

15 integrated within the housing of the handheld input/output display unit, the housing 
includes a recessed thumb indent that includes a switch, e.g., a switch to control 
power to the apparatus or control activation of the three button user input interface, 
and/or the computer processing unit includes a transceiver interface for transmitting 
and receiving data in a wireless environment. 

20 A computer implemented method of navigation in a handheld computer 

apparatus according to the present invention includes providing a handheld 
input/output display unit. The display unit includes a housing sized to be grasped # 
by a user's hand. A computer display and a three button user input interface are 
integrated within the housing. The three button user interface includes an up button, 

25 a down button, and an enter button. The method further includes presenting a menu 
on the computer display listing at least a plurality of menu items corresponding to at 
least a plurality of applications when the enter button is actuated. Further, the three 
button user input interface is used for navigating between the applications and 
within the applications. 
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In one embodiment of the method, the menu presentation includes presenting 
a menu on the computer display listing at least a plurality of application menu items 
corresponding to the plurality of applications and further listing one or more 
application context sensitive menu items corresponding to one of the applications, if 
5 any, upon pressing and holding the enter button. 

In another embodiment of the method, the method further includes 
presenting an application window having a circular navigation interface structure on 
the computer display corresponding to a particular application context sensitive 
menu item. The three button input interface is operable with the circular navigation 
10 interface structure of the application window to navigate within the application 
window. 

In another embodiment of the method, the method further includes 
presenting an application main screen having a tree-based structure on the computer 
display listing a plurality of application options corresponding to a particular 
15 application. The three button user input interface is operable with the tree-based 
structure of the application main screen to navigate within the particular application. 

Brief Description of the Drawings 
Figure 1 is a general illustration of a user grasping a hand-held input/output 
20 display unit for use with a wearable computer unit according to the present 
invention. 

Figure 2 is a block diagram of a personal information processing system 
including a hand-held input/output display unit according to the present invention. 

Figure 3 is a block diagram of one embodiment of the hand-held 
25 input/output display unit of Figure 1 useable with a separate wearable processing 
unit. 

Figure 4 is a perspective view of one illustrative embodiment of the hand- 
held input/output display unit of Figure 1 according to the present invention 
integrating a single-button mouse with a display in the unit. 
30 Figure 5 is a top view of the hand-held input/output display unit of Figure 4. 
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Figure 6 is a bottom view of the hand-held input/output display unit of 
Figure 4. 

Figure 7 is an exploded view of the hand-held input/output display unit of 
Figure 4. 

5 Figures 8A-8B are display screens used to describe the graphical user 

interface for use with the navigational input tools integrated in the hand-held 
input/output display unit of Figure 4. 

Figure 9 is a top view of an alternate embodiment of the hand-held 
input/output display unit of Figure 1 according to the present invention integrating a 
10 two-button mouse with a display in the unit. 

Figure 10 is a top view of an alternate configuration of the hand-held 
input/output display unit of Figure 1 according to the present invention integrating a 
three-button user interface with a display in the unit. 

Figures 1 1 A-l 1J are display screens used for describing a graphical user 
15 interface in conjunction with the three-button user interface of Figure 10 according 
to the present invention. 

Figure 12 is a block diagram of an alternate personal information processing 
system including an alternate hand-held computer device according to the present 
invention, wherein the computing unit is integrated within the hand-held device witl 
20 the display and navigational input tools. 

Figure 13 is a block diagram of further detail of the hand-held computer 
device of Figure 12 including an integrated processing unit. 
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Detailed De scription of the Embodiments 
The present invention shall be described generally with reference to 
Figures 1 and 2. Thereafter, a more detailed description of various embodiments of 
the present invention shall be described with reference to Figures 3-13. 
5 Figure 1 shows a user 1 1 grasping in the user's hand 13 a hand-held 

input/output display unit 12 according to the present invention. The hand-held 
input/output display unit 12 is used by the user 1 1 to view a miniature computer 
display integrated therein with navigational input tools for allowing the user to 
navigate in computer program applications being executed by a wearable computing 
10 unit 14. The hand-held input/output display unit 12 is connected to the wearable 
computer unit 14 by cable 15, e.g., an umbilical cable, to form operative computer 
apparatus 10. One skilled in the art will recognize that with use of 
component/packaging miniaturization and battery miniaturization, the wearable 
computer unit 14 may be completely integrated into the hand-held input/output 
15 display unit 12, as further described herein with reference to Figures 12-13. Further, 
the connection 1 5 between the computer unit 14 and the hand-held input/output 
display unit 12 may be wireless. 

The computer apparatus 10 allows the user 1 1 to move about in an 
environment, e.g., in an industrial or processing plant environment, a military 
20 environment, an educational environment, etc., while still having access to the 

environment's information infrastructure. For example, in a plant environment the 
computer apparatus can be used by personnel, such as field operations and 
maintenance personnel, to enhance situation awareness, increase collaboration 
among and between field and control personnel, and reduce operator-induced 
25 control and communication errors in the day-to-day operations of the environment. 
The present invention is not to be limited to use in any particular environment as the 
present invention may be useful in many different environments, such as any 
environment where a wearable computer would provide application advantages. In 
particular, although the present invention is described in conjunction with 
30 applications for a processing plant environment, the present invention is clearly not 
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limited to such an environment. Further, the present invention may be used solely 
as a wearable computer (i.e., including the input/output display unit having 
integrated navigational tools) without the computer unit having a transceiver for 
wireless connection. 

5 Figure 2 shows a personal information processing system 1 9 wherein 

computer apparatus 10 is used. The computer apparatus 10 according to the present 
invention includes computer unit 14 operatively connected by an electrical 
connection 15 to hand-held input/output display unit 12. 

Generally, the personal information processing system 19 includes wireless 

10 transmission link 25 to deliver digital information from the information 

infrastructure 33 of the environment in which the processing system 19 is used to 
computer apparatus 10. The information infrastructure 33 is generally represented 
by the computer systems 22-24 and main access point 27. One skilled in the art will 
recognize that such an infrastructure may include any configuration of hardware, 

15 software, firmware, transmission links, etc., and that the present invention is limited 
to no particular infrastructure. 

The transmission link 25 supports wireless/digital communication. 
Generally, the wireless transmission link or network 25 of personal information 
processing system 19 may be any conventional link as would be readily known to 

20 one skilled in the art. For example, the transmission link, e.g., an RF network 25, 
may provide a digital wireless local area network (LAN) to support data applications 
associated with the environment of the user 1 1 . Further, for example, in the 
environment where the user is a processing plant user, seamless connectivity and a 
maximized transmission data rate may be required. Such is typically difficult in 

25 processing plant environments where the environment includes a large quantity of 
metallic structures and reinforced buildings and may require a different transmission 
link than is required for other environments. 

In general, the transmission network 25 consists of a main access point 27 
which includes electronics for functioning as an interface between a wired 

30 infrastructure 33 or network, such as is generally shown by computer stations 22-24, 
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and the transceiver 35 of the main access point 27. The transceiver 35 is used for 
transmission/reception via antenna 29. For example, the electronics may convert 
data from. Ethernet into packet data for transmission. Further, the transmission 
network 25 may include several repeaters (not shown) configured to resend signals 

5 transmitted from the main access point 27 to extend the range of the wireless 
communication link to computer apparatus 10. Yet further, the transmission 
network 25 includes a wireless transceiver 3 1 associated with the computer unit 14 
worn by the user 1 1 allowing the user 1 1 to receive and transmit data through 
antenna 17 associated with the computer unit 14. Generally, one skilled in the art 

10 will recognize that conventional modem electronics integrated in the computer unit 
14 fulfills the receive/transmit functionality. 

For example, in one implementation of the transmission network, a wireless 
local area network (LAN) may provide for operation in the 2.4 gigahertz (GHz) 
industrial, scientific, and medical frequency band. The wireless LAN hardware may 

15 operate as a direct sequence spread spectrum (DSSS) system. Range of 
transmission of network 25 is heavily influenced by the amount and type of 
obstructions between the antenna 29 of main access point 27 and antenna 17 of 
computer unit 14 worn by the user 11. Further, such range of communication will 
depend on the gain of such antennas. 

20 Transmission networks 25 are known to those skilled in the art. The 

summary description provided of transmission network 25 above is provided for 
illustration only and it will be recognized by one skilled in the art that various types 
of wireless transmission networks may be utilized in accordance with the present 
invention. 

25 Generally, computer unit 14 may be any conventional wearable computer, 

such as belt-worn Windows 95 computer unit using Pentium processors and having 
hard disk storage, PC card interface, battery power source, etc. For example, such 
wearable computers are available from Via (Northfield, MN). However, preferably, 
the computer unit 14 is a wearable computer for delivering Web-based information 

30 such as a PDA processor. With utilization of a PDA processor, a smaller, lighter 
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weight, lower cost system with better power management and longer lasting battery 
life is obtained. PDA processors generally have low-end power consumption and 
include firmware operating system's availability to eliminate the need for hard disk 
storage which enhances size and weight advantages. 

5 By using Web-based information or, in other words, using a Web-based 

computer system, computer unit 14 can be linked easily into the environment's 
infrastructure 33. For example, using the Web-based system, personnel can log onto 
the user's Website throughout the processing plant to see the current status of 
activities and interact with the personnel through the Website, if necessary (such as 

10 by scheduling tasks). Further, a Web-based system provides the computer apparatus 
10 with a more open development platform for use of a variety of applications and 
in a variety of environments. To implement the Web-based system approach, Java 
virtual machine (JVM) and Java-compliant Web browser technology is used on such 
a PDA processor. 

15 One skilled in the art will recognize that whatever computer unit 14 is 

utilized, appropriate user interface software stored in memory 28 will be tailored 
accordingly. Further, one skilled in the art will recognize that useable computers are 
conventionally known in the art and shall not be described herein in any further 
detail. One preferred hardware computing unit is provided in the specifications of 

20 Table 1. 



Table 1 



Operating System -Hardware 
Architecture 


Support Java 1.1 Web Browser 
800 x 600 PEL resolution for FPD 
Mouse support 


Processing Performance 


OS 

Java VM 

Java Compliant Web Browser 


Flash 


OS Storage 
Java VM Storage 

Java Compliant Web Browser Storage 


RAM 

. — 


32 Mbytes RAM for Web page storage 
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T^am nit A*>n 1 

renpneral 


oianuarQ mouse ivozjz lmcriacc 
Serial, parallel, or PC card interface for 
RF LAN 


Display Drive Circuitry 


Monochrome 16 gray scale SVGA 
800 x 600 resolution @ 60 frames/sec 


Weiaht 


Same as radio, ~1.5 lbs 


Size 


Same as radio, -1.5 lbs 


Battery Life 


8 hours continuous use 
Rechargeable battery implementation 


Operating Temperature 


-40 to +70 degrees Celsius 



According to the present invention, the hand-held input/output display unit 
12 includes a miniaturized display 16 within a housing 20. Integrated with the 
miniaturized display 16 in the hand-held unit 12 are navigational input tools 18 

5 which are used in conjunction with graphical user interface software of computer 
unit 14 to provide a user of the personal information processing system 19 the 
ability to simply and easily navigate through the system. As will be described 
further below, various navigation input tools 1 8 may be used with a variety of 
software user interfaces to provide simple and easy-to-use navigation. The 

10 navigational input tools 1 8 may include any number of buttons, a single-button 
mouse, a two-button mouse, a three-button input interface, etc. Preferably, as will 
be described in further detail herein, the navigational input tools 18 may include a 
three-button interface, a two-button mouse, or a single-button mouse. Each of such 
navigational input tools 18 is integrated within housing 20 of hand-held input/output 

1 5 display unit 1 2 with the miniaturized display 1 6 so as to provide a rugged unit able 
to handle harsh environmental conditions. 

The graphical user interface software stored in memory 28 is generally 
driven by the navigational input tools 18 integrated in hand-held input/output 
display unit 12. For example, a three-button interface requires the need to map data 

20 into a particular structure required for navigation with such a three-button interface, 
whereas the use of a single-button mouse input interface with a pointing device 
allows for a more standard, traditional, point-and-click type of user interface 
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software, e.g., Microsoft Windows look-and-feei. Such user interfaces shall be 
described in further detail below. 

Display 16 of the hand-held input/output display unit 12 may include any 
one of several types of displays for use with the computer units. For example, 

5 display 16 may be a direct view display, such as a direct view laptop display. 
However, display 16 is preferably an optically magnified miniature display, i.e., a 
miniature projection display including a display source with magnification optics. 
Such displays provide advantages over direct view displays in terms of display 
format size, resolution, color, and viewing contrast. Various types of display 

10 sources are available such as flat panel displays which can be used in the 

miniaturized projection display 16. For example, the display source may include 
one or more active matrix electroluminescent (AMEL) displays, organic light 
emitting diode (OLED) displays, ferroelectric displays (FEDs), or active matrix 
liquid crystal displays (AMLCDs). Each have their own advantages and 

15 disadvantages as is known to one skilled in the art. Preferably, however, due to their 
commercial off-the-shelf availability, the display source of display 16 is an off-the- 
shelf miniature 35 millimeter format AMLCD. 

The flat panel display is driven with magnification relay optics. The 
magnification can be accomplished in a number of manners. For example, by 

20 including an optical beam splitter in the design, the displayed image could be 
overlaid on the direct see-through image through the beam splitter (i.e., a see- 
through design). Preferably, however, for simplicity purposes, the image is routed 
from the display directly to the eye, resulting in a so-called see-around design. The 
see-through design is advantageous in that it allows direct comparison (even 1:1 

25 geometric registration, as appropriate) of a scene versus a displayed image, which 
may be useful for a variety of applications, e.g., for setting complex switchboards or 
wire harness layout in a manufacturing process plant. However, because of such 
viewability more display brightness is required and thus battery usage is 
problematic. 
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One skilled in the art will recognize that any number of miniaturized 
projection display configurations may be used in accordance with the present 
invention. As such, the illustrative configurations described herein are not to be 
taken as limiting to the present invention. 

5 The present invention shall be further described with respect to a particular 

configuration of the computer apparatus 10 shown in Figures 3-7 and further used in 
conjunction with a graphical user interface shown and described with reference to 
Figures 8A-8B. As previously described with reference to Figures 1 and 2, 
computer apparatus 10 includes a processing unit 14 and a hand-held input/output 

10 display unit 12 electrically connected thereto by transmission cable 1 5. 

As shown in the perspective view of Figure 4, the hand-held input/output 
display unit 12 includes a longitudinal axis 43 about which a housing 20 encloses 
components of the hand-held input/output display unit 12. The longitudinal axis 43 
extends through the housing 20 from a first end 45 to a second end 47. An upper 

15 surface 44 extends from the first end 45 to the second end 47. Likewise, a bottom 
surface 46 extends from the first end 45 to the second end 47 of a hand-held unit 12. 
The housing 20 further has an eyepiece 49 integrated with the housing 20 at the 
second end 47 of the hand-held unit. At the opposite end, e.g., end 45, a recessed 
finger well 53 is provided such that when the user 1 1 grasps the hand-held unit 12, 

20 the user's little finger is positioned in the recessed finger well 53 for stabilization of 
the unit 12 next to the user's eye. The housing 20 further includes a navigational 
tool recess 55 wherein are positioned and integrated within housing 20 navigation^ 
tool interface 48. In this particular embodiment of the hand-held unit 12, the 
navigational tools include a force-actuated single-button mouse including a mouse 

25 pointer actuator 50 and a single-button actuator 5 1 . The housing 20 further includes 
microphone openings 54 for access to a microphone. 

The housing 20 and the navigational tool interface 48 are configured for 
holdability. In other words, the design is such that a gloved hand can hold and 
operate the navigational tool interface 48. In the configuration of Figure 4, the top- 

30 mounted integrated single-button mouse is provided for navigation of the system. 
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The forefinger of the user's hand operates the button actuator 51 and the middle 
finger of the user's hand operates the pointer actuator 50. 

Figure 5 shows a top view of the hand-held unit 12 further showing the 
navigational tool interface 48, eyepiece 49, upper surface 44, navigational tool 
5 recess 55, and microphone opening(s) 54. The single-button mouse generally lies 
below a ruggedly constructed surface layer 61 to provide for use in harsh 
environments. 

Figure 6 is a bottom view of the hand-held unit 12 and further shows in 
detail eyepiece 49 and bottom surface 46. Bottom surface 46 includes a recessed 

10 thumb well 57 that includes an integrated switch 58. The switch 58 is positioned 
below a ruggedly constructed surface cover layer 67 such that when the user grasps 
the hand-held unit 12, the user's forefinger is over the button actuator 51, the user's 
middle finger is over the pointer actuator 50 while the user's thumb is positioned 
within recessed thumb well 57 and able to actuate switch 58. Further, the user's 

15 pinkie finger is positioned in recessed finger well 53, e.g., a back ledge ridge. The 
overall configuration including the recessed features, in addition to providing for 
integration of the navigational input tools with the display 62 in the hand-held 
input/output display unit, also provide to assist in the positioning of the user's hand 
over the single-button mouse and to stabilize grip support. 

20 The switch 58 actuated by the thumb of a user is a safety switch which may 

be used to prevent accidental navigational input tool actuation, such as during 
positioning of the unit 12 away from the eye, e.g., holstering of the device in a 
holder at the user's side. In such a case, continuous pressing of the switch allows 
for use of the navigational tools while the switch is pressed. Further, the safety 

25 switch 58 serves to conserve power. In one conservation of power mode, the switch 
must be actuated prior to power being supplied to the device. Further, the switch 58 
can be made operable to only provide power upon continuous holding of the switch 
58 or can be made operable to provide continuous use of the mouse within a 
predetermined timeout period once the switch 58 has been activated. 
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Figure 7 shows an exploded view of the hand-held input/output display unit 
12 including components of one particular illustrative configuration. In this 
particular configuration, the hand-held monocular input/output display unit 12 
integrates single-button mouse components 59 with an off-the-shelf miniature 35 

5 millimeter format AMLCD display 62. The display components include a miniature 
flat panel monochrome Sony display available under the trade designation 
LCX016L. The flat panel display shown generally as the grouping of display 
components 62 is an 800 x 600 pixel (SVGA) display using a Sanyo cold cathode- 
type fluorescent backlight. With the proper polarizers and drive signal format, this 

10 device is capable of 256 gray levels and 200:1 contrast ratio performance. An air- 
spaced double achromatic doublet objective lens is configured according to the 
specifications shown in Table 2 below. 



Table 2 - Relay Optics Design Specifications 



Field-of-View 


25 degree H x 20 degree V 
30 degree diagonal 


Monocular Field-of-View 


25 degree H x 20 degree V 


Resolution 


800 x 600 24jam pixels 


Nyquist Acuity 


-20/37 for the Sony AMLCD 


MTF 


Between 0.1 and 0,3 at 15 cyc/mm 


Minimum Eye Relief 


32 mm 


Exit Pupil 


10 


Accommodation 


1.0m 


Field Curvature 


± 0.25 diopter 


Distortion 


<5% 


Image Source Active Area 


20 mm x 26.6 mm 



15 The display 62 is positioned within the housing 20 so as to be viewable through 
eyepiece 49 which includes the grouped components illustrated generally in Figure 
7. 
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One skilled in the art will recognize that the present invention is not limited 
to a monocular-type device but may be binocular as well. However, to preserve size 
and weight, a monocular device is preferred. 

The exploded view of Figure 7 further illustrates the top surface 44 and the 
5 bottom surface 46 of the housing 20 which substantially encompass the components 
of the unit. A single component containing board 65 includes the electronics 
necessary to drive the display 62 using a corresponding Sony driver chip set. The 
single board 65 allows for incorporation of the single-button mouse 59 generally 
represented by the exploded grouped components of force-actuated single-button 
10 mouse. For example, the mouse may be a Hula Point™ Hall effect mouse pointing 
device made by USAR Systems, Inc., (New York City, NY), operatively coupled to 
board 65 to provide mouse signaling to computer unit 14. Tactile rebound feedback 
for the mouse disk of the single-button mouse 59 is provided by the elastomeric 
properties of the molded cover or surface layer 61 . Further, a single-shielded 1 1- 
1 5 conductor curly cable with a standard 1 5-pin D PC display connector completes the 
hand-held unit 12 to connect the hand-held input/output display unit 12 to the 
computing unit 14. 

Further shown in Figure 7 is the switch 58 which is provided with flexible 
cover 67. The switch 58 is further operable with the single board 65 to provide 
20 switch signals to computer unit 14. Switch 58 is a standard switch such as a C&K 
pushbutton switch available from DigiKey (Thief River Falls, MN). 

The single board 65 is used for mounting and/or integrating the components 
and connectors as shown in Figure 3. The circuitry contained within the housing 20 
of hand-held input/output display unit 12 includes circuitry for communication to 
25 processing unit 14 through connector 30 and for providing the information for 
driving display 16 through display connector 32. 

The board 65 housed in the hand-held input/output display unit 12 includes a 
power supply component 34, serial port/mouse component 42, microphone 40, 
display driver 36, and timing circuit 38. Power supply component 34 receives 
30 power through connector 30 and controls power to the hand-held input/output 
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display unit 12. For example, power supply component 34 provides for reset of the 
components of hand-held unit 12 and also for control of power supply to display 
unit 12 upon actuation of switch 58. Power supply component 34 does not provide 
power to the display unit 12 unless the switch 58 has been actuated. Further, power 
5 supply component 34 is turned off upon activation of a sleep mode when display 
unit 12 has not been utilized for a particular period of time as determined by timing 
circuit 38. 

Serial port/mouse 42 provides for the interface between the single-button 
mouse user interface 48 including force-actuated pointer 50 and button 5 1 and the 

10 computer unit 14. As operation of such conventional single-button mouses are 
known to those skilled in the art, details with respect thereto will not be provided. 
The serial port/mouse 42 provides pointing signals and button actuation signals 
through connector 30 to computing unit 14 for use in control of the graphical user 
interface software for the system, e.g., stored in memory 28. The serial port/mouse 

15 42 may further include a motor for providing vibration for notification purposes 
such as in a paging situation, or may further include an audible alert such as a 
piezoelectric buzzer. In addition, the serial port/mouse 42 may include a beeper for 
such notification purposes* 

Display driver 36 and timing circuit 38 provide adequate signaling through 

20 display connector 32 to display 16 for displaying information from computing unit 
14 input to hand-held unit 12 through connector 30. Timing circuit 38 provides for 
sync signals to synchronize display 16 with the display driver 36. As previously # 
described, such components are off-the-shelf components utilized in conjunction 
with the displays, such as those available from Sony, and will not be described in 

25 further detail. 

Microphone 40 is generally representative of one or more microphones 
positioned within the housing 20. For example, the microphones may be used for 
voice activation of the computer unit and/or voice input to the system. As the 
handheld device is held in close proximity to the mouth, voice activation may be 

30 readily accomplished. Further, a microphone may be positioned relative to the 
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upper surface 44, e.g., microphone openings 54, and another microphone may be 
positioned relative to the lower surface 46, to provide multiple inputs, e.g., one 
voice input and one environment input, for carrying out noise reduction and/or 
interference processing using such multiple inputs, e.g. common mode noise 

5 rejection. The display unit may include any additional circuitry necessary for 
processing or conditioning of such inputs. 

With use of the direct manipulation input device, e.g., the single-button 
mouse interface 58, a look-and-feel similar to that of conventional graphical user 
interfaces can be implemented, for example, a Windows 95-type look-and-feel. The 

10 application software may be any of a number of applications applicable to a 

particular environment such as maintenance applications for a processing plant, e- 
mail functions, etc. 

The personal information processing system preferably is used with an 
environment infrastructure having applications written in Java. With the 

1 5 applications written in Java, a dedicated server for the environment can provide up- 
to-date information to the user 1 1 of the computer apparatus 10 according to the 
present invention. For example, a dedicated server may access near real-time 
process data from a refinery history module which provides historical data regarding 
the plant's processing history and may also access relational databases that store 

20 refinery or plant procedures, task schedules, and personnel information. It should be 
readily apparent that various applications may be utilized in accordance with the 
present invention and in no manner is the present invention limited to use with or for 
applications involving a processing plant, e.g., a refinery, a pulp mill, etc. One 
example of application software used by a field operator is in part shown in the 

25 Figures 8A and 8B. 

As is typical with many software systems, an opening screen requires a user 
to log onto the system and enter any other relevant data, e.g., current job, password, 
etc. Once logged onto the system, the user 1 1 can navigate using a point-and-click 
feel with a traditional pull-down menu graphical user interface as shown in display 

30 screen 8 1 . Such a graphical user interface useable with a single-button or two- 
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button mouse is known to those skilled in the art and will not be described in detail. 
In addition to the traditional pull-down menu interface, the user can navigate to 
different applications using one of the taskbars 80 located at the bottom of the 
screen 81. For example, the "View Todays Tasks" bar as shown in Figure 8 A 

5 displays all scheduled tasks 85 assigned to the employee's logged-on position for 
the current shift when selected, as shown in screen 81 and 86 of Figures 8 A and 8B. 

One benefit to on-line interactive procedures is that the procedures can be 
made more context-sensitive. For example, in a processing plant environment, as 
shown in Figure 8B, by displaying live process data right inside a procedure step 

10 and allowing outside operators to enter outside readings directly from the field, one 
provides a more context-sensitive procedure. Conventionally such a procedure 
required operators to call in readings to a central control room operator to ensure 
that the control systems readings of those levels were calibrated with the manual 
readings displayed in the field. With the present system, outside operators can see 

15 live process data, precluding the need to bother the central control room operator. 

Further, as shown with regard to Figure 8 A, the user 1 1 can select "Schedule 
Tasks" to navigate to different days and shifts to see what is scheduled and what has 
been completed in the past. The "Review All Tasks" option may allow operators to 
review any procedure entered into the system as opposed to viewing today's tasks 

20 and being able to sign-off or change such tasks. The "View Process Data" option 
may allow a user to select and view any process data point in the plant, i.e., receive 
information from the dedicated server allowing access to historical data and current 
information concerning the plant operation. Further, the system has navigation 
buttons similar to most browsers (Back, Forward, and Reload) as well as a context- 

25 sensitive help system which provides help relative to the current screen being 
displayed when the Help button is selected. As represented by taskbar 82, the 
system is a Web-based system. In this particular case, Microsoft Internet Explorer 
is used for communication. 

One skilled in the art will recognize that a two-button mouse 90 may be 

30 integrated with the display 16 in the hand-held input/output display unit 12. A top 
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view of the two-button mouse interface 90 is shown in Figure 9. With the use of an 
additional button actuator, the hand-held unit 12 may become slightly longer. The 
two-button mouse 90 includes a pointing actuator 91, a right button actuator 92 and 
a left button actuator 93. Such mouse structures are integrated into the unit 12 in 

5 much the same way as described with reference to Figures 3-8. The two-button 
mouse user interface 90 may be used with similar graphical user interface software 
(i.e., a Windows-type look-and-feel) as described with reference to Figures 3-8. 

As described above, the navigational input tools, i.e., the single-button 
mouse and the two-button mouse configurations, utilize a graphical user interface 

10 that generally relies on the standard Microsoft Windows look-and-feel, which 

basically requires either a full keyboard or mouse, a trackball, pen input device, or 
the like. Generally, such interfaces require interactions involving control buttons, 
drop-down menus, dialogue boxes, and multiple, simultaneously opened-tiled 
windows. This conventional type of graphical user interface was generally designed 

15 for desktop computers and such user interface is fully supported by the wearable 
computer apparatus 10 according to the present invention. However, in many cases, 
depending upon the nature of the interface environment, the graphical user interface 
and navigational input tools (i.e., user interface) may need to be made simpler for 
navigational control of software applications in such environments. Such 

20 environments may require a minimal amount of distraction or attention. 

A user interface which provides such simplicity shall be described with 
reference to Figures 10-11. The configuration for hand-held input/output display 
unit 100 shown in Figure 10 includes a three-button user interface 102. The three- 
button interface 102 is integrated with a display (not shown) viewable through 

25 eyepiece 103 in housing 120 in substantially a similar manner to that previously 

described with reference to Figures 3-8 with the exception of an additional button as 
opposed to a pointing device. As shown in Figure 10, three-button user interface 
102 includes an Enter button 106 positioned in the middle of Up and Down buttons 
104, 108. In other words, the Up and Down buttons 104, 108 are positioned on 

30 either side of middle Enter button 1 06. 
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The three-button interface 102 is used with a software graphical user 
interface implemented from memory (e.g., memory 28, Figure 2) of the computer 
unit to implement a simple user interface. Generally, the interface environment 
includes only a single window open at a time, a simple pop-up navigation menu 

5 with application menu items and context-sensitive menu items, and other simple 
interface elements which will be described in further detail with reference to Figures 
1 1 A-l 1 J. This user interface provides a look-and-feel that is substantially different 
than a Microsoft Windows-type look-and-feel. 

Generally, navigation in the system using the graphical user interface and the 

10 navigational input three-button user interface is performed either using a pop-up 

menu to navigate between display screens wherein the pop-up menu includes at least 
application menu items and context-sensitive menu items, or follows a tree structure 
or a circular structure further described below to navigate within a particular 
application. The look-and-feel for the interface uses a variation of a hierarchical file 

1 5 view for screen navigation and control, which is very suitable for an up/down/select 
navigational input approach. Likewise, by clustering all control objects on a single 
pop-up menu with context-sensitive menu items, an inter-screen navigation scheme 
which is well-suited to a three-button interface input approach is created. 

The graphical user interface software was authored in Visual Basic. The 

20 ability to navigate from one Visual Basic screen to another creates an almost 
scrolling functionality for the look-and-feel of the graphical user interface. For 
example, as further described below, a user 1 1 is able to move through a series of 
trend screens representing different processing plant devices with an almost 
scrolling effect. The user interface design used a general mapping of application 

25 information requirements to the three-button interface hardware. It will be readily 
apparent to one skilled in the art that the user interface described herein may be used 
with any applications and are not restricted to processing plant applications 
described illustratively herein. For example, a processing plant is the location or 
facility at which the hand-held input/output display unit 100 is to be used and the 

30 applications pertaining to such a processing plant may include applications relating 
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to personnel, maintenance, processes, procedures, e-mail. In accordance with the 
present invention, other applications with regard to other facilities, locations, or any 
other environments may benefit from the user interface look-and-feel as described 
herein. 

5 The Up and Down buttons 104, 108 are single-button function buttons. 

However, the Enter button 106 positioned between the Up and Down buttons 104, 
108 is a multi-function button. By pressing and holding the multi-function Enter 
button a pop-up menu is called. Once the pop-up menu is displayed on the screen, 
the user 1 1 can navigate up and down the menu by use of the Up and Down buttons 

10 104, 108. The multi-function Enter button 106 can then be used to select an option 
of the pop-up menu by pressing and releasing or, in other words, clicking the Enter 
button 106. 

One skilled in the art will recognized that the multiple functions of the Enter 
button can be provided in a number of manners. For example, one function may be 

1 5 provided by clicking the button whereas another function may be provided by 

pressing and holding the button as described above. Further, the multiple functions 
can be provided by clicking and double clicking. As used herein, pressing and 
holding is encompassing of other manners of providing a function other than simple 
single clicking, e.g., pressing and holding encompasses double clicking or any other 

20 actuation technique other than the single click. 

To describe the graphical user interface in conjunction with the navigational 
input tool interface, i.e., the three-button user input interface 102, the display 
screens shown in Figure 11A-11J shall be described with respect to a particular 
illustrative processing plant environment and illustrative applications used in such 

25 an environment. As previously indicated, the data and applications used in 

describing this interface look-and-feel are for illustration only and various other 
environments and applications relating thereto may benefit from the look-and-feel 
described herein. It will be noted that all interaction with the interface to be 
described with reference to Figures 1 1A-11J can be accomplished with the three- 
30 button interface 102 (i.e., mouse and keyboard are not required). 
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Figure 1 1 A shows a splash display screen 130 which occurs at start-up. 
Upon start-up, the splash display screen 130 does not include pop-up menu 131. 
Pop-up menu 131 is invoked by pressing and holding the middle Enter button 106. 
The pop-up menu 131, at this point in the user interface, includes only application 
menu items 133 and a cancel option 132. The cursor 134 shown by the highlighted 
Personnel menu item moves up or down the menu and includes wrap-around with 
use of the Up and Down buttons 104, 108. Selection of an application from the pop- 
up menu 131 is accomplished by pressing and releasing, i.e., clicking, the Enter 
button 106 with the cursor 134 highlighting the application menu item. Selection of 
an application option dismisses the splash display screen 130 and launches an 
application window associated with the application selection. The cancel option 132 
is the default position when the pop-up menu is displayed. Selecting the cancel 
option 132 serves to cancel the pop-up menu display, for example, in the case where 
the user called up the menu by accident or decided to go back to the previous screen 
that was being used. 

Figure 1 IB shows a display screen 140 which is the main application 
window for the Personnel application selected from splash screen 130 of Figure 
1 1 A. Cursor movement in the main window 140 for this application and for other 
applications is limited to the information tree 143 at the left side of the display 
screen 140. The information tree 143 includes, for example, personnel information 
with respect to various processes. At this junction, the information tree 143 is 
shown only in its highest level including only top-level tree items 146. Details 
regarding the tree item highlighted by the cursor is provided in a display area 142 to 
the right of the tree 143. In this display screen 140, the lower level tree items are 
currently hidden. The window title bar 144 provides the user 1 1 with information 
regarding the identification of the current application in which the user 1 1 is 
operating, i.e., Personnel. Generally, the display screen 140 does not include the 
pop-up menu 141 until the Enter button 106 is pressed and held. 

The pop-up menu 141 displayed with the main window display screen 140 
of the Personnel application includes one or more application-specific context- 
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sensitive menu items 147 on the bottom of the pop-up menu 141. Such context- 
sensitive menu items 147 are dependent upon the application in which the user is 
operating. The context-sensitive menu items will be described further below. 
Figure 1 1C shows a main window display screen 150 for the Personnel 

5 application but shows mid-level details 1 52 with regard to a selected top level tree 
item 146. The next level of the tree is selected by pressing and releasing, e.g., 
clicking, the Enter button 106. Selection of an alternate top level tree item 146 in 
the information tree 143 hides the currently exposed mid-level detail and exposes 
the mid-level detail for the newly selected top level tree item 146. Display screen 

10 150 shows information tree 143 with the second level detail 152 exposed or, in other 
words, one o'f the top level tree elements 146 expanded. Note that the triangle in 
front of the top level tree element expanded rotates when the detail is exposed. 
Display screen 150 further shows a display area 154 for the mid-level tree item 
highlighted by the cursor. The top level tree display area 142 is displayed with the 

15 mid-level tree display area 1 54. Once again, the pop-up menu 141 will not be 
displayed unless the Enter button 106 is pressed and held to initiate display of the 
pop-up menu 141. 

Figure 1 ID shows an additional level 162 of tree detail for information tree 
143. The additional level 162 of tree data detail is exposed by selecting a second 

20 level tree item 1 52. Display area 1 65 is used to show information with regard to this 
additional level 162 of information tree 143 along with the display areas 154 for the 
second level and display area 142 used to display information of the top level tree 
item. As noted by the boxes next to the items of the additional level 162, various 
other functional or procedural items may be added for use by the user such as 

25 selecting certain personnel or marking that procedures have been accomplished, or 
various other simple input elements. Once again, display screen 160 is generally 
shown without the pop-up menu 141 unless the middle Enter button 106 is pressed 
and held as previously described. 

Upon selection of context-sensitive menu item 147 of pop-up menu 141 

30 from display screen 160, a secondary window is provided on display screen 170 as 
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shown in Figure 1 IE. In this particular circumstance, the context-sensitive menu 
item is a "View Map" menu item which, when selected, provides a map of the 
facility or environment where the user 1 1 is located, designated generally as 
reference numeral 171. It should be recognized that other context-sensitive menu 

5 items may provide additional display screens with regard to other personnel-related 
matters. For example, global positioning may be used to give absolute position of 
the user 11, maps showing position of other personnel, etc. Title bar 173 provides 
the user 1 1 with identification of the particular context-sensitive menu item being 
viewed. Once again, upon pressing and holding the middle Enter button 106, pop- 

10 up menu 172 is displayed with a context-sensitive menu item 175 therein, i.e., 
"Close Map" menu item. 

Display screen 1 80 of Figure 1 IF shows the main window for the 
Maintenance application as opposed to the Personnel application. As identified in 
window title bar 179, the display screen 180 includes display of tree structure 181 

15 including top level items 182, second level items 183, and third level items 184. 

Also displayed are display areas 187 associated with the top level tree items 182, the 
display area 188 associated with second level tree items 183, and display area 189 
associated with third level tree items 1 84. Upon pressing and holding Enter button 
106, pop-up menu 185 is displayed. Pop-up menu 185 includes the application 

20 menu items along with a context-sensitive menu item "View IDL" 1 86. Upon 

selection of this context-sensitive pop-up menu item 186 at the lowest level of tree 
detail in the maintenance window shown in display screen 180, a display screen 190 
as shown in Figure 1 1G is shown. 

With respect to the display screen 190, the circular type of navigation within 

25 an application shall be described. Generally shown on display screen 1 90 is a 
device schematic 192, e.g., a debutanizer tower schematic. The device schematic 
192 includes various sub-task areas 194. The Up and Down buttons 104, 108 move 
the cursor 195 in a circular fashion from sub-task 194 to sub-task 194 around the 
device schematic 192. The cursor 195 is represented as a highlighted sub-task label. 

30 As the cursor 1 95 is moved from sub-task to sub-task, the description in sub-task 
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block 196 changes to a description associated with the particular sub-task 
highlighted. Further, pressing and releasing the middle Enter button 106 toggles the 
checkmarks for the highlighted sub-task to provide a further informational or 
completed status for the sub-task. 

5 One skilled in the art will recognize that the circular nature of the navigation 

described herein is clearly not limited to device schematics but is applicable to any 
particular display configuration where a user would want to move within the screen 
display to select different options therein. For example, the screen display may be a 
map with various locations on the map being navigated through in a circular 

10 manner. Further, pop-up menu 191 can be displayed upon pressing and holding the 
Enter button 106 and then can be used to close the context-sensitive menu item 197, 
i.e., "Close IDL." 

Figure 1 1H shows the main window of the Process application in display 
screen 200. The elements displayed include the informational tree 201 having top 

15 level items 202 and second level items 205 expanded and shown. Window title bar 
209 shows user 1 1 that the Process application is being used. Further, display area 
203 shows information associated with a top level item 202 and display area 204 
displays information associated with one of the second level items 205. Further 
shown in Figure 1 1H is pop-up menu 208 which includes three context-sensitive 

20 menu items 206 including "View Schematic," "View Trend," and "View Camera." 

Selection of "View Schematic" is very similar in nature to that described 
with reference to Figure 1 1G and a display screen 210 showing a device schematic 
21 1 is provided such as shown in Figure 1 II. Once again, various sub-tasks 212 are 
associated with the device schematic 21 1 and can be navigated in a circular manner. 

25 Information block 214 at the bottom of the screen 210 provides up-to-date 

information with respect to the highlighted sub-task or device element Further 
shown on display 210 is a pop-up menu 213 that includes several additional context- 
sensitive menu items 215 for the particular highlighted sub-task 212 of device 
schematic 21 1. For example, selection of "View Trends" of context-sensitive menu 

30 items 215 results in a display screen 220 showing trends with respect to a particular 
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sub-task such as shown in Figure 1 1 J. In this particular case, the trend is with 
respect to an overhead pressure controller and the trend is shown in graphical form. 
However, other forms of displaying trends are also applicable. 

Shown on screen 220 in title bar 221 is the context-sensitive menu item 
selected by the user 11, i.e., Trends. Further shown is a pop-up menu 213 attained 
as previously described which includes several context-sensitive menu items 224 for 
performing various tasks at this point in the user interface. 

It will be noted that trends may be selected at both the sub-task level and at 
the device schematic level. For example, "View Trends" context-sensitive menu 
item is available as shown in Figure 1 1H and also as shown in Figure 1 1 1. 

In summary, with regard to the graphical user interface and navigational 
three-button input interface 102, navigating around a display with just the Up and 
Down buttons 104, 108, and Enter button 106 is achieved primarily using a tree- 
based user interface control. For example, in the Process data application, the main 
screen uses a tree structure as a means to navigate to groups of data that are related 
to pieces of equipment, such as the compressors, towers, furnaces, etc. of a plant. 
The user can move up and down the tree by using the Up and Down buttons 104, 
108. The user can collapse and expand the information tree by clicking the Enter 
button 106. Further, clicking on the Enter button 106 at the end of a particular tree 
structure, such as when particular personnel are listed and a box therein is to be 
checked, serves to accomplish a function such as to check off that step. 

Further, in addition to tree-based navigation, an additional type of navigation 
within an application window is the circular navigation. For example, using the 
context-sensitive menu options available when viewing process data, the user can 
navigate to trends of the data and schematics that show the data in a process flow 
diagram type of format. These types of screens do not display a tree structure. 
Rather, these sub-screens are specific to the process data being displayed on the 
main screen when the menu option is called up. For example, if one selects "View 
Schematic" when looking at process data for a C-3 tower process data, the 
schematic displayed is relevant to the C-3 tower. Once viewing the schematic, as 
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illustrated in Figure 111, the user can "circle around the display" in one direction by 
clicking the Up button 104 or circle around the display in the other direction by 
clicking the Down button 108. When viewing trends of the data, as described with 
respect to Figure 1 1 J, the trend related to one point fills an entire screen, so pressing 
the Up or Down buttons cycle the user through a set of trends related to the group of 
points in question; for example, the various sub-tasks related to the C-3 tower as 
shown in Figure 1 II. Navigating back to previous screens is performed by using the 
context-sensitive menu which generally has options for closing the currently viewed 
screen. 

One skilled in the art will recognize that the particular look-and-feel 
described with reference to Figures 1 1 A-l 1 J requires the need to map the data into 
the structure required by the navigation scheme. For example, the data must be 
mapped into the various tree level items. 

Figures 12 and 13 show an alternative configuration for the computer 
apparatus according to the present invention. In this particular configuration, the 
processing unit is integrated into the hand-held display unit as opposed to the use of 
a separate connected computing unit. As shown in Figure 12, the personal 
information processing system 300 includes a wireless transmission link 301 which 
is substantially similar to that described with reference to Figures 1 and 2. The only 
difference is that the transceiver 370 of the link is now integrated within housing 
324 of the hand-held computer apparatus 320, as opposed to being a part of a 
separate computing unit 

The hand-held computer apparatus 320 as shown in Figure 12 includes 
housing 324. The housing 324 substantially encloses computer unit/display driver 
hardware and/or software 330 operable under user navigational tools 328 and 
integrated within the housing 324 with display 326. Antenna 322 and 
transceiver/modem circuitry 370 form a part of the wireless transmission link 301. 

The different configurations for the navigational tools 328 and computing 
unit 330 as well as display 326 are substantially the same as indicated previously 
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with respect to the other embodiments described above. However, miniaturization 
allows them all to be integrated within housing 324. 

In one particular implementation, hardware and/or software 330 includes 
transceiver 370 and the other elements as shown and described with reference to 
Figure 13. The hand-held apparatus 32 includes hardware and/or software 330, 
display 326, and power source 366, e.g., lithium ion batteries. The 
hardware/software 330 generally includes the following: transceiver circuitry 370, 
processor 372, display driver circuitry 374, DRAM 376, along with human 
navigation interface circuitry 328 for use with the applicable navigational tools. The 
transceiver circuitry 370 may use a dual-spread spectrum system. Processor 372 
may be a processor such as a processor available under the Pentium® trade 
designation with a display controller, PCMCIA master controller, and memory 
interface. The display 326 and associated driving circuitry 374 may be any 
commercially available display and driver such as those previously described herein. 
Further, human navigation interface may be any configuration for supporting the 
navigational tools described herein. 

Although the invention has been described with particular reference to 
preferred embodiments thereof, variations and modifications to the present invention 
can be made within a contemplated scope of the claims as is readily known to one 
skilled in the art. 
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What is claimed is: 

1 . A computer apparatus comprising: 

a computer processing unit for operating upon data and providing data for 
display; and 

a handheld input/output display unit, the display unit comprising: 

a housing sized to be grasped by a user's hand, wherein the housing 
includes an eyepiece, 

a computer display located within the housing at a position to allow 
the user to view the display through the eyepiece, 

' a display driver for use in displaying data from the processor device 
on the computer display, and 

a three button user input interface integrated with the computer 
display in the housing and operatively connected to provide user input to the 
processing unit, wherein the three button user interface includes an up 
button, a down button, and an enter button, wherein the enter button is 
operable to present a menu on the computer display listing at least a plurality 
of menu items corresponding to at least a plurality of applications, and 
further wherein the three button user input interface is operable to navigate 
between the applications and within the applications. 

2. The apparatus of claim 1 , wherein the computer processing unit includes: 
means for displaying the menu on the computer display upon pressing and 

holding the enter button; and 

means for selecting one of the menu items of the menu upon clicking the 

enter button. 

3. The apparatus of claim 1, wherein the enter button is further operable to 
present a menu on the computer display listing a plurality of application menu items 
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corresponding to a plurality of applications, and further listing application context 
sensitive menu items corresponding to one of the applications, if any. 

4. The apparatus of claim 1 , wherein the enter button is operable to present on 
the computer display an application window having a circular navigation interface 
structure corresponding to a particular application context sensitive menu item, and 
further wherein the three button user input interface is operable with the circular 
navigation interface structure to navigate within the application window. 

5. The apparatus of claim 4, wherein the computer processing unit includes: 
means for moving through a circular series of options for the circular 

navigation interface structure associated with the particular application context 
sensitive menu item upon clicking of the up button and/or down button; and 

means for causing the display of information corresponding to a particular 

option. 

6. The apparatus of claim 4, wherein the computer processing unit includes 
means for changing a state of data within the circular navigation interface structure 
upon clicking of the enter button. 

7. The apparatus of claim 1 , wherein the enter button is operable to select one 
of the plurality of applications to present an application main screen having a tree- 
based structure on the computer display listing a plurality of application options 
corresponding to the selected application, and further wherein the three button user 
input interface is operable with the tree-based structure of the application main 
screen to navigate within the tree-based structure for the selected application, 

8. The apparatus of claim 7, wherein the computer processing unit includes 
means for changing a state of data within the tree based structure upon clicking of 
the enter button. 
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9. The apparatus of claim 7, wherein computer processing unit includes: 
means for moving up and down the application options of the tree-based 

structure upon clicking of the up button and/or down button, wherein the tree-based 
5 structure includes two or more levels; 

means for collapsing and expanding portions of the tree-based structure upon 
clicking on the enter button; and 

means for causing the display of information corresponding to a state of the 
tree on the computer display. 

10 

10. The apparatus of claim 1 , wherein the computer processing unit is integrated 
within the housing of the handheld input/output display unit. 

1 1 . The apparatus of claim 1 , wherein the housing includes an upper surface and 
15 a lower surface, wherein the three button user input interface is integrated within the 

housing and operable at the upper surface of the housing, wherein the lower surface 
includes a recessed thumb indent, and further wherein the recessed thumb indent 
includes a switch. 

20 12. The apparatus of claim 1 1, wherein the switch controls power to the 
apparatus. 

1 3 . The apparatus of claim 1 1 , wherein the switch controls activation of the 
three button user input interface. 

25 

14. The apparatus of claim 1 , wherein computer processing unit includes a 
transceiver interface for transmitting and receiving data in a wireless environment. 

15. A computer apparatus for operating in a wireless environment, the computer 
30 apparatus comprising: 
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a computer processing unit, the processing unit comprising: 

a transceiver interface for transmitting and receiving data in 
the wireless environment, and 

a processor device for operating upon such data and operable 
to provide data for display; and 
a handheld input/output display unit, the display unit comprising: 

a housing sized to be grasped by a user's hand, wherein the 
housing includes an eyepiece, 

a computer display located within the housing at a position to 
allow the user to view the display through the eyepiece, 

a display driver for use in displaying data from the processing 
unit on the computer display, and 

a three button user input interface integrated with the 
computer display in the housing and operatively connected to provide 
user input to the processing unit, wherein the three button user interface 
includes an up button, a down button, and an enter button, wherein the 
enter button is operable to present a menu on the computer display listing 
a plurality of application menu items corresponding to a plurality of 
applications and further listing one or more application context sensitive 
menu items corresponding to one of the applications, if any, and further 
wherein the three button user input interface is operable to navigate 
between the applications and within the applications; 
wherein the computer processing unit further includes: 
means for displaying the menu on the computer display upon pressing and 
holding the enter button; 

means for selecting one of the menu items of the menu upon clicking the 
enter button; 

means for presenting on the computer display an application window having 
a circular navigation interface structure corresponding to a particular application 
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context sensitive menu item upon using the enter button to click on the particular 
application context sensitive menu item; 

means for moving through a circular series of options for the circular 
navigation interface structure associated with the particular application context 
5 sensitive menu item upon clicking of the up button and/or down button; 

means for causing the display of information corresponding to a particular 

option; 

means for presenting an application main screen having a tree-based 
structure on the computer display listing a plurality of application options 
10 corresponding to a particular application menu item upon using the enter button to 
click on the particular application menu item; 

means for moving up and down the application options of the tree-based 
structure upon clicking of the up button and/or down button, wherein the tree-based 
structure includes two or more levels; 
15 means for collapsing and expanding portions of the tree-based structure upon 

clicking on the enter button; and 

means for causing the display of information corresponding to a state of the 
tree on the computer display. 

20 16. The apparatus of claim 1 5, wherein the computer processing unit is 
integrated within the housing of the handheld input/output display unit. 

1 7. The apparatus of claim 1 5 wherein the housing includes an upper surface and 
a lower surface, wherein the three button user input interface is integrated within the 

25 housing and operable at the upper surface of the housing, wherein the lower surface 
includes a recessed thumb indent, and further wherein the recessed thumb indent 
includes a switch. 

18. The apparatus of claim 17, wherein the switch controls power to the 
30 apparatus. 
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1 9. The apparatus of claim 1 7, wherein the switch controls activation of the 
three button user input interface. 

5 20. A computer implemented method of navigation in a handheld computer 

apparatus, the method comprising: 

providing a handheld input/output display unit, the display unit comprising a 

housing sized to be grasped by a user's hand, wherein a computer display and a 

three button user input interface are integrated within the housing, and further 
10 wherein the three button user interface includes an up button, a down button, and an 

enter button; 

presenting a menu on the computer display listing at least a plurality of menu 
items corresponding to at least a plurality of applications when the enter button is 
actuated; and 

15 navigating between the applications and within the applications using the 

three button user input interface. 

2 1 . The method of claim 20, wherein the method further includes selecting one 
of the menu items of the menu upon clicking the enter button. 

20 

22. The method of claim 20, wherein the menu presentation step includes 
presenting a menu on the computer display listing at least a plurality of application 
menu items corresponding to the plurality of applications and further listing one or 
more application context sensitive menu items corresponding to one of the 

25 applications, if any, upon pressing and holding the enter button. 

23. The method of claim 22, wherein the method further includes presenting an 
application window having a circular navigation interface structure on the computer 
display corresponding to a particular application context sensitive menu item, 

30 wherein the three button input interface is operable with the circular navigation 
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interface structure of the application window to navigate within the application 
window. 

24. The method of claim 23, wherein navigation within the application window 
5 includes: 

moving through a circular series of options for the circular navigation 
interface structure associated with the particular application context sensitive menu 
item upon clicking of the up button and down button; and 

causing the display of information corresponding to a particular option. 

10 

25. The method of claim 23, wherein navigation within the application window 
includes changing a state of data within the circular navigation interface structure 
upon clicking of the enter button. 

15 26. The method of claim 20, wherein method further includes presenting an 

application main screen having a tree-based structure on the computer display listing 
a plurality of application options corresponding to a particular application, the three 
button user input interface is operable with the tree-based structure of the 
application main screen to navigate within the particular application. 

20 

27. The method of claim 26, wherein navigation within the particular application 
includes: 

moving up and down the application options of the tree-based structure upon 
clicking of the up button and/or down button, wherein the tree-based structure 
25 includes two or more levels; 

collapsing and expanding portions of the tree-based structure upon clicking 
on the enter button; and 

causing the display of information corresponding to a state of the tree on the 

computer display. 
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28. The method of claim 26, wherein navigation within the particular application 
includes changing a state of data within the tree-based structure upon clicking of the 
enter button. 

29. A computer implemented method of navigation, the method comprising: 
providing a computer display; 

providing a three button user input interface, wherein the three button user 
interface includes an up button, a down button, and an enter button; 

presenting a menu on the computer display listing at least a plurality of menu 
items corresponding to at least a plurality of applications when the enter button is 
actuated; and 

navigating between the applications and within the applications using the 
three button user input interface. 

30. The method of claim 29, wherein the method further includes selecting one 
of the menu items of the menu upon clicking the enter button. 

31. The method of claim 29, wherein the menu presentation step includes 
presenting a menu on the computer display listing at least a plurality of application 
menu items corresponding to the plurality of applications and further listing one or 
more application context sensitive menu items corresponding to one of the 
applications, if any, upon pressing and holding the enter button. 

32. The method of claim 31, wherein the method further includes presenting an 
application window having a circular navigation interface structure on the computer 
display corresponding to a particular application context sensitive menu item, 
wherein the three button input interface is operable with the circular navigation 
interface structure of the application window to navigate within the application 
window. 
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33. The method of claim 32, wherein navigation within the application window 
includes: 

moving through a circular series of options for the circular navigation 
interface structure associated with the particular application context sensitive menu 
5 item upon clicking of the up button and down button; and 

causing the display of information corresponding to a particular option. 

34 . The method of claim 32, wherein navigation within the application window 
includes changing a state of data within the circular navigation interface structure 

10 upon clicking of the enter button. 

35. The method of claim 29, wherein method further includes presenting an 
application main screen having a tree-based structure on the computer display listing 
a plurality of application options corresponding to a particular application, the three 

15 button user input interface is operable with the tree-based structure of the 
application main screen to navigate within the particular application. 

36. The method of claim 35, wherein navigation within the particular application 
includes: 

20 moving up and down the application options of the tree-based structure upon 

clicking of the up button and/or down button, wherein the tree-based structure 

includes two or more levels; 

collapsing and expanding portions of the tree-based structure upon clicking 

on the enter button; and 
25 causing the display of information corresponding to a state of the tree on the 

computer display. 

37. The method of claim 35, wherein navigation within the particular application 
includes changing a state of data within the tree-based structure upon clicking of the 

30 enter button. 

38 



WO 99/57628 



1/23 



PCT/US99/09524 




WO 99/57628 



2/23 



PCT/US99/09524 



1?- 
/ 


%3 
1 






1 \ 




1 " 




3 ^ 





WO 99/57628 PCT/US99/09524 

3/23 




r 



WO 99/57628 



5/23 



PCT/US99/09524 




I 



I 

i 



WO 99/57628 



6/23 



PCT/US99/09524 



<v3 




i 



WO 99/57628 



7/23 



PCT/US99/09524 




WO 99/57628 



8/23 



PCT/US99/09524 




WO 99/57628 PCT/US99/09524 

9/23 



□ Pip* - Hicfosoft Internet Explorer 




Call in the following levels at VRU200. 

„ level, do not agree. blo«dc»n me,i B htgla». "}^^J 0 ^ <«""• " ,Ue " W °* 
" otdei lo setAenair level indication!. 




WO 99/57628 PCT/US99/09524 

10/23 



7 



WO 99/57628 



11/23 



PCT/US99/09524 




|2,t> 



WO 99/57628 



12/23 



PCT/US99/09524 




WO 99/57628 



13/23 



PCT/US99/09524 




WO 99/57628 



14/23 



PCT/US99/09524 




WO. 99/57628 



15/23 



PCT/US99/09524 




WO 99/57628 PCT/US99/09524 

16/23 




WO 99/57628 



17/23 



PCT/US99/09524 




WO 99/57628 



PCT/US99/09524 



18/23 




WO 99/57628 



19/23 



PCT/US99/09524 



A 



r ► Wet Gas Compressor 
C3 Debtianizer Tower 
-t*J PC 202 Overhead Premio Control* 



PC 203 C P. Pte«we Ccnirolfe 



FC 204 PurpAioisid Flow 
£ Tl 200 Debutaniref Steam Temper aiu© 
^ FC201 DebUarner Steam Flow 
4*1 FC 202 Feed Row Controler 
- ^ FunaeaF20 



jgGeneral Electric 
Isolated 

"oT 



if- 



i 



A- 



View Schematic 



WO 99/57628 



20/23 



PCT7US99/09524 



( 



H C-3 Dchulanger Towcf 




WO 99/57628 



21/23 



PCT/US99/09524 




22/23 



PCT/US99/09524 



jL 



\ 



\ 



7-1 



3 \ 



3^ 



33 <5 




3zO 



WO 99/57628 



23/23 



PCT/US99/09524 




INTERNATIONAL SEARCH REPORT 


Intet onai Application No 

PCT/US 99/09524 


A. CLASSIFICATION OF SUBJECT MATTER 

IPC 6 G06F1/16 G06F3/00 




According to International Patent Classification (IPC) or to both national classification and IPC 




B. FIELDS SEARCHED 


Minimum documentation searched (classification system followed by classification symbols) 

IPC 6 G06F 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practical, search terms used) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


Y 


EP 0 540 393 A (THOMSON CSF) 


1,2,10, 




5 May 1993 (1993-05-05) 


14,20, 






21,29,30 




column 6, line 39 - column 12, line 48 




figures 5A-6.8 




A 




3,4,7,15 


Y 


EP 0 637 794 A (XEROX CORP) 


1,2,10, 




8 February 1995 (1995-02-08) 


14,20, 






21,29,30 




column 4, line 42 - column 10, line 22 




figures 1A-4B 




A 




3,4,7,15 




-/-- 





Further documents are listed in the continuation of box C. 



Patent family members are listed in annex. 



0 Special categories of cited documents : 

"A" document defining the general state of the art which is not 
considered to be of particular relevance 

"E" earlier document but published on or after the international 
filing date 

V document which may throw doubts on priority clafm(s)or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 
other means 

P" document published prior to the international filing date but 
later than the priority date claimed 



T* later document published after the international filing date 
or priority date and not In conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

"X" document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
Involve an inventive step when the document is taken alone 

"Y" document of particular relevance; the claimed invention 
cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
In the art. 

document member of the same patent family 



Date of the actual completion of the International search 

29 July 1999 


Date of mailing of the international search report 

05/08/1999 


Name and mailing address of the ISA 

European Patent Office. P.B. 5818 Patentlaan 2 
NL-2280HV Rijswijk 
Tel. (431-70) 340-2040, Tx. 31 651 epo nl, 
Fax: (431-70) 340-3016 


Authorized officer 

Baldan, N 



Form PCT/lSA/210 (second shevt) (July 1992) 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



Into onal Applleation No 

PCT/US 99/09524 



C.(Contlnuatlon) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category • Citation of document, with indication .where appropriate, of the relevant passages 



Relevant to claim No. 



WO 95 21408 A (KEY INFORMATION DELIVERY) 

10 August 1995 (1995-08-10) 
page 13, line 20 - page 14, line 27 
page 19, line 10 - page 21, line 15 
figures 3-7,17-28 

REKIM0T0 J ET AL: "THE WORLD THROUGH THE 
COMPUTER: COMPUTER AUGMENTED INTERACTION 
WITHREAL WORLD ENVIRONMENTS" 
UIST '95. 8TH ANNUAL SYMPOSIUM ON USER 
INTERFACE SOFTWARE AND TECHNOLOGY. 
PROCEEDINGS OF THE ACM SYMPOSIUM ON USER 
INTERFACE SOFTWARE AND TECHNOLOGY, 
PITTSBURGH, PA, NOV. 14 - 17, 1995, 
14 November 1995 (1995-11-14), pages 
29-36, XP000634412 

ASSOCIATION FOR COMPUTING MACHINERYISBN: 
0-89791-709-X 
the whole document 

SIEWIOREK D P: "WEARABLE COMPUTERS: 
MERGING INFORMATION SPACE WITH THE 
WORKSPACE" 

PROCEEDINGS OF THE INTERNATIONAL 
CONFERENCE ON COMPUTER DESIGN: VLSI IN 
COMPUTERS AND PROCESSORS, CAMBRIDGE, MA., 
OCT. 3-6, 1993, 

3 October 1993 (1993-10-03), page 10/11 
XP000463368 

INSTITUTE OF ELECTRICAL AND ELECTRONICS 
ENGINEERS 

the whole document 

ASIM SMAILAGIC ET AL: "MODALITIES OF 
INTERACTION WITH CMU WEARABLE COMPUTERS" 
IEEE PERSONAL COMMUNICATIONS, 
vol. 3, no. 1, 

1 February 1996 (1996-02-01), pages 14-25, 
XP00O554689 
ISSN: 1070-9916 
the whole document 



1,15,20, 
29 



1,15,20, 
29 



1,15,20, 
29 



1,15,20, 
29 



Form PCT/ISAA10 (continuation ol second shoot) (July 1992) 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

.nformatlon on patent family members 



Inter ma\ Application No 

PCT/US 99/09524 



Patent document 
cited in search report 


Publication 
date 


Patent family 
members) 


Publication 
date 


EP 0540393 


A 




FR 


2683330 A 


A7 AC 1AQO 








DE 


69221700 D 


25-09-1997 








DE 


69221700 T 


29-01-1998 








US 


5579165 A 


26-11-1996 


EP 0637794 


A 


08-02-1995 


JP 
US 


7078120 A 
5825675 A 


20-03-1995 
20-10-1998 



W0 9521408 


A 


10-08-1995 


US 


5491651 A 


13-02-1996 








AU 


695631 B 


20-08-1998 








AU 


2090095 A 


21-08-1995 








CA 


2182799 A 


10-08-1995 








EP 


0748473 A 


18-12-1996 








JP 


10502468 T 


03-03-1998 








US 


5581492 A 


03-12-1996 








us 


5798907 A 


25-08-1998 



Form PCT/tSA/21 0 (patent famtty annex) (Jury 1 992) 



